Image processing apparatus

ABSTRACT

An image processing apparatus includes generating means for generating image data, transmitting means for transmitting predetermined image data to an external device, the predetermined image data being generated by performing a predetermined process for pixel range conversion on the image data, and control means for performing control such that predetermined data relating to the predetermined image data generated by the predetermined process and the predetermined image data are transmitted to the external device.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.14/031,429 filed on Sep. 19, 2013, which is a Continuation ofInternational Patent Application No. PCT/JP2013/060793, filed Apr. 10,2013, which claims the benefit of Japanese Patent Application No.2012-101667, filed Apr. 26, 2012, and No. 2012-101668 filed Apr. 26,2012. These applications are hereby incorporated by reference herein intheir entirety.

TECHNICAL FIELD

The present invention relates to, for example, an image processingapparatus that transmits image data outside the apparatus.

BACKGROUND ART

A communication interface, called High-Definition Multimedia Interface(HDMI) (registered trademark), has been developed. A communicationsystem compliant with the HDMI standard includes a source device and asink device. The source device can transmit image data through the HDMI.The sink device can receive image data from the source device throughthe HDMI and display an image based on the received image data on adisplay.

A source device has been known that acquires extended displayidentification data (EDID), which contains information about aresolution of a sink device, from the sink device (refer to JapanesePatent Laid-Open No. 2009-77347). This source device generates data tobe transmitted to the sink device using the EDID acquired from the sinkdevice.

In such a communication system, the source device performs a conversionprocess for converting image data stored in the source device into imagedata compliant with a transmission method in the HDMI standard in orderto transmit the image data to the sink device. In this case, the sourcedevice then transmits the image data generated by the conversion processto the sink device in accordance with the transmission method in theHDMI standard. The sink device receives the image data from the sourcedevice and enables the image data received from the source device inaccordance with the transmission method in the HDMI standard to beviewed, recorded, edited, and managed. In this case, the source devicedoes not transmit information about the image data, transmitted by thesource device, to the sink device. Disadvantageously, it is difficult tomanage the image data received from the source device in the sinkdevice.

Additionally, in this case, the source device does not transmitinformation about the image data to be subjected to the conversionprocess by the source device to the sink device. Disadvantageously, itis difficult to manage the image data received from the source device inthe sink device.

SUMMARY OF INVENTION

According to an aspect of the present invention, image data can beappropriately managed by a sink device.

According to an aspect of the present invention, in cases where imagedata is transmitted to the sink device, the sink device can be informedof information about the image data transmitted to the sink device.

According to an aspect of the present invention, in the case that imagedata is transmitted to the sink device, the sink device can be informedof information about the image data to be transmitted to the sinkdevice.

According to an aspect of the present invention, an image processingapparatus includes generating means for generating image data,transmitting means for transmitting predetermined image data to anexternal device, the predetermined image data being generated byperforming a predetermined process for pixel range conversion on theimage data, and control means for performing control such thatpredetermined data relating to the predetermined image data generated bythe predetermined process and the predetermined image data aretransmitted to the external device.

According to an aspect of the present invention, a method includes thesteps of generating image data, generating predetermined image data byperforming a predetermined process for pixel range conversion on theimage data, and performing control such that predetermined data relatingto the predetermined image data generated by the predetermined processand the predetermined image data are transmitted to an external device.

Further features of the present invention will become apparent from thefollowing description of exemplary embodiments with reference to theattached drawings.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a diagram illustrating an example of a communication systemaccording to first and second embodiments.

FIG. 2 is a diagram illustrating an example of an image transmissionsystem according to the first and second embodiments.

FIG. 3 is a diagram illustrating an example of a first process accordingto the first and second embodiments.

FIG. 4 is a diagram illustrating an example of a second processaccording to the first and second embodiments.

FIGS. 5A and 5B are diagrams illustrating examples of display screenimages displayed on an image processing apparatus according to the firstand second embodiments.

FIG. 6 is a diagram illustrating an example of additional data accordingto the first and second embodiments.

FIG. 7 is a diagram illustrating an example of a receiving apparatusaccording to the first and second embodiments.

FIG. 8 is a diagram illustrating an example of a configuration of a filegenerated in the receiving apparatus according to the first and secondembodiments.

FIGS. 9A and 9B are diagrams illustrating an example of operation forediting image data in the image processing apparatus according to thesecond embodiment.

DESCRIPTION OF EMBODIMENTS

Embodiments of the present invention will be described below withreference to the drawings. It should be understood that the followingembodiments are illustrative only and that the present invention is notlimited to the following embodiments.

First Embodiment

In a communication system according to a first embodiment, asillustrated in FIG. 1, an image processing apparatus 100 and a receivingapparatus 300 are connected by a connection cable 200 such that theapparatuses can be in communication with each other. The imageprocessing apparatus 100, the connection cable 200, and the receivingapparatus 300 in the communication system according to the firstembodiment are devices capable of performing communication compliantwith the High-Definition Multimedia Interface (HDMI) (registeredtrademark) standard. In the first embodiment, the connection cable 200is a communication interface compliant with the HDMI standard.

The connection cable 200 includes a power line (not illustrated), a hotplug detect (HPD) line (not illustrated), and a display data channel(DDC) line 201. The connection cable 200 further includes atransition-minimized differential signaling (TMDS) line 202 and aconsumer electronics control (CEC) line 203.

The image processing apparatus 100 may be an image sensing apparatus,such as a digital single-lens reflex camera, a digital still camera, ora digital video camera, or may be a communication apparatus, such as amobile phone or a smartphone. The image processing apparatus 100 may beany electronic device including means for generating image data. Thereceiving apparatus 300 may be a display apparatus, such as atelevision, a personal computer, or a projector, or may be a recordingapparatus, such as a recorder or a hard disk drive.

The image processing apparatus 100 will now be described with referenceto FIG. 1. The image processing apparatus 100 includes a centralprocessing unit (CPU) 101, a memory 102, a communication unit 103, animage sensing unit 104, an image processing unit 105, a recording unit106, a display unit 107, and an operation unit 108. A system includingthe communication unit 103, the image sensing unit 104, the imageprocessing unit 105, and the recording unit 106 will be referred to asan image transmission system 400. FIG. 2 illustrates a configuration ofthe image transmission system 400.

The CPU 101 controls an operation of the image processing apparatus 100in accordance with a computer program stored in the memory 102. The CPU101 analyzes device information about the receiving apparatus 300acquired from the receiving apparatus 300, thus determining an imagedisplay capability and an audio processing capability of the receivingapparatus 300. The device information about the receiving apparatus 300is extended display identification data (EDID) or enhanced EDID (E-EDID)recorded in the receiving apparatus 300. The EDID and the E-EDID eachcontain identification information of the receiving apparatus 300 andinformation concerning, a resolution, a scanning frequency, an aspectratio, a color space, and the like supported by the receiving apparatus300. The E-EDID, serving as enhanced EDID, contains more capabilityinformation items than the EDID. The E-EDID contains informationconcerning formats of video data and audio data supported by thereceiving apparatus 300. In the following description, both the EDID andthe E-EDID will be referred to as “EDID”.

The image processing apparatus 100 acquires EDID from the receivingapparatus 300 through the DDC line 201 and analyzes the EDID acquiredthrough the DDC line 201. The image processing apparatus 100 candetermine the image display capability and the audio processingcapability of the receiving apparatus 300 based on an analysis of theEDID. Furthermore, the image processing apparatus 100 can generate videodata and audio data suitable for the image display capability and theaudio processing capability of the receiving apparatus 300.

The memory 102 functions as a work area of the CPU 101. The memory 102further stores the EDID acquired from the receiving apparatus 300,information concerning the image processing apparatus 100, an analysisby the CPU 101, and the like. The work area of the CPU 101 is notlimited to the memory 102 and may include an external memory, such as ahard disk drive.

The communication unit 103 includes a connection terminal (connector)for connection of the connection cable 200. The communication unit 103further includes an EDID acquiring unit 103 a, a data transmitting unit103 b, and a command processing unit 103 c.

The EDID acquiring unit 103 a acquires EDID through the DDC line 201from the receiving apparatus 300. The EDID acquired from the receivingapparatus 300 by the EDID acquiring unit 103 a is supplied to the CPU101.

The data transmitting unit 103 b transmits video data suitable for theimage display capability of the receiving apparatus 300, audio datasuitable for the audio processing capability of the receiving apparatus300, and auxiliary data through the TMDS line 202 to the receivingapparatus 300. The video data and the audio data to be transmitted tothe receiving apparatus 300 by the data transmitting unit 103 b aregenerated based on the EDID acquired by the EDID acquiring unit 103 a.Image data transmitted to the receiving apparatus 300 by the datatransmitting unit 103 b may include at least one of still image data andmovie data.

The command processing unit 103 c can transmit a command compliant withthe CEC protocol to the receiving apparatus 300 connected through theCEC line 203. Furthermore, the command processing unit 103 c can receivea command compliant with the CEC protocol from the receiving apparatus300 connected through the CEC line 203.

The command processing unit 103 c can supply a command received from thereceiving apparatus 300 to the CPU 101. The CPU 101 analyzes the commandsupplied from the command processing unit 103 c and controls the imageprocessing apparatus 100 based on an analysis of the command. A commandto be transmitted to the receiving apparatus 300 is generated by the CPU101.

A configuration of the image sensing unit 104 is illustrated in FIG. 2.The image sensing unit 104 includes an optical system 104 a and an imagesensor 104 b. The image sensing unit 104 photoelectrically converts anobject optical image formed by light entered through the optical system104 a to generate analog data. The analog data generated by the imagesensing unit 104 is supplied to the image processing unit 105. The imagesensor 104 b includes a CMOS sensor or a CCD sensor.

A configuration of the image processing unit 105 is illustrated in FIG.2. The image processing unit 105 includes a signal processing unit 105a, an encoding processing unit 105 b, a frame rate conversion unit 105c, and a pixel range conversion unit 105 d.

The image processing unit 105 controls the signal processing unit 105 asuch that the analog data supplied from the image sensing unit 104 issubjected to processes for conversion from analog data to digital data,e.g., gain control and color interpolation, thus generating image data.

The image data generated by the signal processing unit 105 a is suppliedto the encoding processing unit 105 b and the frame rate conversion unit105 c. The image data generated by the signal processing unit 105 a issupplied through the encoding processing unit 105 b in the recordingunit 106. The image data generated by the signal processing unit 105 ais supplied to the communication unit 103 through the frame rateconversion unit 105 c and the pixel range conversion unit 105 d.

The encoding processing unit 105 b performs an encoding process on theimage data supplied from the signal processing unit 105 a. The encodingprocess includes a process for encoding image data by, for example,adaptive discrete cosine transform (ADCT). Examples of methods of imagedata encoding include the JPEG method, the MPEG method, and the RAWmethod. The image data encoded by the encoding processing unit 105 b issupplied to the recording unit 106.

The frame rate conversion unit 105 c performs a first process for framerate conversion on the image data supplied from the signal processingunit 105 a. The first process includes a process for converting a firstframe rate relating to the image data supplied from the signalprocessing unit 105 a into a second frame rate. The first frame rate isa frame rate of the image data supplied from the signal processing unit105 a to the frame rate conversion unit 105 c. The second frame rate isa frame rate defined by the HDMI standard for transmission of image datathrough the TMDS line 202. A frame rate of image data to be transmittedthrough the TMDS line 202 to the receiving apparatus 300 has tocorrespond to the second frame rate.

If the first frame rate does not correspond to the second frame rate,the frame rate conversion unit 105 c has to convert the first frame rateinto the second frame rate. In the case that the first frame rate doesnot correspond to the second frame rate, the frame rate conversion unit105 c converts the frame rate of image data into the second frame rateand the resultant data is supplied to the pixel range conversion unit105 d. If the first frame rate corresponds to the second frame rate, theframe rate conversion unit 105 c supplies image data, which is suppliedfrom the signal processing unit 105 a, to the pixel range conversionunit 105 d without converting the first frame rate. In the case that thefirst frame rate corresponds to the second frame rate, the frame rateconversion unit 105 c does not perform the first process.

FIG. 3 illustrates an example of the first process. For example, thefirst frame rate is 30p and image data supplied from the signalprocessing unit 105 a to the frame rate conversion unit 105 c includes aframe A and a frame C. In this case, the second frame is, for example,60i. The frame rate conversion unit 105 c divides the frame A relatingto the 30p frame rate into an even-numbered field Ae and an odd-numberedfield Ao. The frame rate conversion unit 105 c further divides the frameC relating to the 30p frame rate into an even-numbered field Ce and anodd-numbered field Co. Consequently, the image data relating to the 30pframe rate is converted into image data relating to a transmission framerate of 60i. The frame rate conversion unit 105 c supplies the imagedata subjected to the first process to the data transmitting unit 103 bso that the even-numbered field Ae, the odd-numbered field Ao, theeven-numbered field Ce, and the odd-numbered field Co are transmitted tothe receiving apparatus 300 in that order.

The pixel range conversion unit 105 d performs a second process forpixel range conversion on image data supplied from the frame rateconversion unit 105 c. Pixel range data indicates a range of black towhite levels in video content.

The second process includes a process for converting a first pixel rangerelating to image data, which is supplied from the frame rate conversionunit 105 c, into a second pixel range. The first pixel range is a pixelrange of image data supplied from the frame rate conversion unit 105 cto the pixel range conversion unit 105 d. The second pixel range is apixel range defined by the HDMI standard for transmission of image datathrough the TMDS line 202. A pixel range of image data to be transmittedthrough the TMDS line 202 to the receiving apparatus 300 has tocorrespond to the second pixel range. If the first pixel range does notcorrespond to the second pixel range, the pixel range conversion unit105 d has to convert the first pixel range into the second pixel range.

In the case that the first pixel range does not correspond to the secondpixel range, the pixel range conversion unit 105 d converts the pixelrange of image data into the second pixel range and the resultant imagedata is supplied to the data transmitting unit 103 b. If the first pixelrange corresponds to the second pixel range, the pixel range conversionunit 105 d supplies image data, which is supplied from the frame rateconversion unit 105 c, to the data transmitting unit 103 b withoutconverting the first pixel range. In the case that the first pixel rangecorresponds to the second pixel range, the pixel range conversion unit105 d does not perform the second process.

The pixel range conversion unit 105 d performs the second process usingEquation 1 described below. In Equation 1, a denotes a pixel value ofimage data supplied from the frame rate conversion unit 105 c and bdenotes a pixel value of image data to be transmitted to the receivingapparatus 300 by the data transmitting unit 103 b.

$\begin{matrix}{b = {{a \times \left( \frac{255 - 16}{255} \right)} + 16}} & (1)\end{matrix}$

An example of the second process will now be described with reference toFIG. 4. In this case, for example, the first pixel range is from 0 to255 (8 bits) and the second pixel range is from 16 to 255 (8 bits). Forexample, “0” in the first pixel range represents the black level and“255” represents the white level. Furthermore, for example, “16” in thesecond pixel range represents the black level and “255” represents thewhite level. In this case, the pixel range of image data supplied fromthe frame rate conversion unit 105 c is converted from the first pixelrange of “0 to 255” into the second pixel range of “16 to 255” based onEquation 1 by the pixel range conversion unit 105 d. In addition, theimage processing unit 105 may generate image data to be supplied to thedata transmitting unit 103 b based on the EDID acquired by the EDIDacquiring unit 103 a.

The data transmitting unit 103 b transmits image data supplied from thepixel range conversion unit 105 d through the TMDS line 202 to thereceiving apparatus 300 in response to an instruction from the CPU 101.

A configuration of the recording unit 106 is illustrated in FIG. 2.While being connected to a recording medium 106 a, the recording unit106 can record data in the recording medium 106 a. Furthermore, whilebeing connected to the recording medium 106 a, the recording unit 106can read data recorded in the recording medium 106 a. While beingdisconnected from the recording medium 106 a, the recording unit 106cannot record data in the recording medium 106 a and read data from therecording medium 106 a. The recording medium 106 a may be a recordingdevice built in the image processing apparatus 100 or may be an externalrecording device detachable from the image processing apparatus 100. Therecording medium 106 a may be a memory card or may be a hard disk drive.

The recording unit 106 includes a file generating unit 106 b. Therecording unit 106 controls the file generating unit 106 b to perform aprocess for generating a file for image data supplied from the encodingprocessing unit 105 b. A file generated by the file generating unit 106b contains image data encoded by the encoding processing unit 105 b andstatus data relating to the image data. The status data is dataindicating setting for generation of the image data. The status dataincludes data indicating a frame rate of frames included in the imagedata, data indicating a time code for each frame included in the imagedata, data indicating the pixel range of the image data, and a file nameof the image data.

The file generating unit 106 b adds a time code to each frame of imagedata encoded by the encoding processing unit 105 b, thus generating afile. The recording unit 106 records the file generated by the filegenerating unit 106 b in the recording medium 106 a. Furthermore, therecording unit 106 can supply status data relating to the file generatedby the file generating unit 106 b to the communication unit 103.

The display unit 107 includes a display, such as a liquid crystaldisplay. While the image processing apparatus 100 is in a capturingmode, the display unit 107 displays an image based on image datagenerated by the image sensing unit 104 and the image processing unit105. While the image processing apparatus 100 is in a playback mode, thedisplay unit 107 displays an image based on image data read from therecording medium 106 a.

The operation unit 108 provides a user interface for operating the imageprocessing apparatus 100. The operation unit 108 includes buttons,switches, and a touch panel for operating the image processing apparatus100. The CPU 101 can control the image processing apparatus 100 inaccordance with an instruction entered through the operation unit 108 bya user. If the user operates any button of the operation unit 108, anoperation signal associated with the button is supplied from theoperation unit 108 to the CPU 101. The CPU 101 analyzes the operationsignal supplied from the operation unit 108 and determines a processassociated with the operation signal based on an analysis. The CPU 101controls the image processing apparatus 100 to perform the processassociated with the operation signal supplied from the operation unit108.

The user can set the image processing apparatus 100 to at least one ofthe capturing mode and the playback mode using the operation unit 108.While the image processing apparatus 100 is in communication with thereceiving apparatus 300 through the connection cable 200, the user canset additional data to be transmitted by the data transmitting unit 103b using the operation unit 108. The additional data is data to betransmitted through the TMDS line 202 to the receiving apparatus 300 bythe data transmitting unit 103 b. The additional data includes datarelating to image data to be transmitted through the TMDS line 202 tothe receiving apparatus 300 by the data transmitting unit 103 b. Forexample, the additional data includes data indicating the first framerate to be subjected to the first process by the frame rate conversionunit 105 c. The additional data may further include data indicating thesecond pixel range set by the second process through the pixel rangeconversion unit 105 d. The additional data may further include dataindicating a file name of a file generated by the file generating unit106 b. The additional data may further include data indicating a timecode for each frame of image data contained in the file generated by thefile generating unit 106 b.

FIGS. 5A and 5B illustrate examples of display screen images displayedon the display unit 107. FIG. 5A illustrates a first screen image 501that corresponds to image data for setting a recording format of imagedata to be generated by the optical system 104 a, the image sensor 104b, and the signal processing unit 105 a. While the first screen image501 is displayed on the display unit 107, the user can control a cursor502 using the operation unit 108 so as to select a desired recordingformat. In this case, the CPU 101 controls the optical system 104 a, theimage sensor 104 b, and the signal processing unit 105 a to generateimage data in the recording format selected by the cursor 502. Imagedata recording formats which the user can set using the cursor 502 onthe first screen image 501 include a resolution and a frame rate.

FIG. 5B illustrates a second screen image 503 that corresponds to imagedata for setting whether transmission of additional data is enabled.While the second screen image 503 is displayed on the display unit 107,the user can control a cursor 504 using the operation unit 108 to selecttransmission or non-transmission of additional data.

In this case, if “Enabled” is selected as setting for transmission ofadditional data by the cursor 504, the CPU 101 permits image datasupplied from the image processing unit 105 to the data transmittingunit 103 b and additional data relating to the image data to betransmitted to the receiving apparatus 300.

In this case, if “Disabled” is selected as setting for transmission ofadditional data by the cursor 504, the CPU 101 permits image datasupplied from the image processing unit 105 to the data transmittingunit 103 b to be transmitted. In this case, however, the CPU 101inhibits additional data relating to the image data supplied from theimage processing unit 105 to the data transmitting unit 103 b from beingtransmitted.

An operation of the image processing apparatus 100 in the case where thedata transmitting unit 103 b transmits additional data to the receivingapparatus 300 will now be described. In this case, “Enabled” is selectedby the cursor 504 as setting for transmission of additional data.

A case where the image processing apparatus 100 is in the capturing modeand image data generated in a recording format set on the first screenimage 501 is recorded in the recording medium 106 a will be describedbelow. In this case, the image processing apparatus 100 performs aprocess for recording image data generated by the image sensing unit 104and the image processing unit 105 in the recording medium 106 a and aprocess for transmitting the image data generated by the image sensingunit 104 and the image processing unit 105 to the receiving apparatus300. In this case, the data transmitting unit 103 b transmits the imagedata, which is supplied from the image processing unit 105, andadditional data relating to the image data, which is to be transmitted,through the TMDS line 202 to the receiving apparatus 300. In this case,the additional data to be transmitted to the receiving apparatus 300includes data indicating the first frame rate and data indicating thesecond pixel range. In this case, the additional data to be transmittedto the receiving apparatus 300 further includes data indicating a filename of a file relating to the image data transmitted to the receivingapparatus 300. In this case, the additional data to be transmitted tothe receiving apparatus 300 further includes data indicating a time codefor each frame of the image data contained in the file relating to theimage data transmitted to the receiving apparatus 300.

A case where the image processing apparatus 100 is in the capturing modeand image data generated by the image sensing unit 104 and the imageprocessing unit 105 is not recorded in the recording medium 106 a willbe described below. In this case, the image processing apparatus 100performs a process for generating live view image data using the imagesensing unit 104 and the image processing unit 105 and a process fortransmitting the image data, which is generated by the image sensingunit 104 and the image processing unit 105, to the receiving apparatus300. In this case, the data transmitting unit 103 b transmits the imagedata, which is supplied from the image processing unit 105, andadditional data relating to the image data, which is to be transmitted,through the TMDS line 202 to the receiving apparatus 300. In this case,the additional data to be transmitted to the receiving apparatus 300includes data indicating the first frame rate and data indicating thesecond pixel range. In this case, the additional data to be transmittedto the receiving apparatus 300 includes data indicating a file name ofthe next file to be recorded. Note that the additional data to betransmitted to the receiving apparatus 300 includes no data indicating atime code. The reason is that the live view image data is generated bythe image sensing unit 104 and the image processing unit 105 but a filerelating to the live view image data is not generated by the filegenerating unit 106 b.

A case where the image processing apparatus 100 is in the playback modewill be described below. In this case, the image processing apparatus100 performs a process for reading image data from a file recorded inthe recording medium 106 a and a process for transmitting the image dataread from the recording medium 106 a to the receiving apparatus 300. Inthis case, the image data read from the recording medium 106 a isdecompressed by a decompression unit (not illustrated) and is thensupplied through the frame rate conversion unit 105 c and the pixelrange conversion unit 105 d to the data transmitting unit 103 b. In thiscase, the decompressed image data may be subjected to the first processby the frame rate conversion unit 105 c and/or the second process by thepixel range conversion unit 105 d. In this case, the data transmittingunit 103 b transmits the image data supplied from the image processingunit 105 and additional data relating to the image data, which is to betransmitted, through the TMDS line 202 to the receiving apparatus 300.In this case, the additional data to be transmitted to the receivingapparatus 300 includes data indicating the frame rate of the image datasupplied to the frame rate conversion unit 105 c after decompression anddata indicating the second pixel range. The data indicating the framerate of the image data supplied to the frame rate conversion unit 105 cafter decompression is data that indicates the frame rate of the imagedata to be subjected to the first process by the frame rate conversionunit 105 c. In this case, the additional data to be transmitted to thereceiving apparatus 300 further includes data indicating a file name ofa file relating to the image data to be transmitted to the receivingapparatus 300. In this case, the additional data to be transmitted tothe receiving apparatus 300 includes data indicating a time code foreach frame of the image data contained in the file relating to the imagedata to be transmitted to the receiving apparatus 300.

The additional data to be transmitted through the TMDS line 202 to thereceiving apparatus 300 by the data transmitting unit 103 b can beprovided using, for example, Vendor-Specific InfoFrame. Vendor-SpecificInfoFrame is packet data that can be defined for each manufacturer(maker).

FIG. 6 illustrates an example of additional data to be transmittedthrough the TMDS line 202 by the data transmitting unit 103 b. It isassumed that the additional data illustrated in FIG. 6 is transmittedfor each frame included in image data transmitted by the datatransmitting unit 103 b. In FIG. 6, HB0 to HB2 correspond to a header ofthree bytes. Data associated with Vendor-Specific InfoFrame is describedin HB0 to HB2. The header (HB0 to HB2) of Vendor-Specific InfoFrame istransmitted from the image processing apparatus 100 to the receivingapparatus 300 through TMDS Channel 0 included in the TMDS line 202.

In FIG. 6, PB0 to PB16 correspond to a body of 17 bytes. Data indicatingVendor ID of the image processing apparatus 100 is described in PB0 toPB2. Vendor ID is identification data indicating a manufacturer (maker)of the image processing apparatus 100.

In PB3 to PB6, data associated with a time code is described. Dataindicating a frame number in the time code is described in PB3, dataindicating “second” in the time code is described in PB4, dataindicating “minute” in the time code is described in PB5, and dataindicating “hour” in the time code is described in PB6.

In PB7, data indicating the first frame rate is described. When thefirst frame rate is “30p”, data representing “30p” is described in PB7.Data described in PB7 indicates a frame rate of image data generated bythe image sensing unit 104 and the image processing unit 105 before thefirst process. The data described in PB7 consists of eight bits. Themost significant bit of the data described in PB7 represents whetherimage data to be subjected to the first process is interlaced orprogressive. When image data to be subjected to the first process isinterlaced, the most significant bit of the data described in PB7 is 0.When the image data to be subjected to the first process is progressive,the most significant bit of the data described in PB7 is 1. Low-orderseven bits of the data described in PB7 represent a frame or field rate.For example, when the image data to be subjected to the first process is30p, the low-order seven bits of the data described in PB7 are“10011110”. For example, when the frame rate of the image data to besubjected to the first process is 60i, the low-order seven bits of thedata described in PB7 are “00111100”.

In PB8, data indicating the second pixel range is described. The datadescribed in PB8 indicates the pixel range of image data generated afterthe second process. The data described in PB8 indicates the white levelin the second pixel range. Since “16” representing the black level inthe second pixel range is defined in the HDMI standard, this level maybe omitted in PB8. When the second pixel range is “16 to 255”, datarepresenting “255” is described in PB8.

In PB9 to PB16, data indicating a file name is described. The datadescribed in PB9 to PB16 is represented using the American Standard Codefor Information Interchange (ASCII) codes. For example, a case where afile corresponding to a file name “MVI_0001” is recorded in therecording medium 106 a and image data is transmitted through the TMDSline 202 to the receiving apparatus 300 by the data transmitting unit103 b will be described below. In this case, “0x4D” representing “M” isdescribed in PB9, “0x56” representing “V” is described in PB10, and“0x49” representing “I” is described in PB11. In addition, “0x5f”representing “_” is described in PB12, “0x30” representing “0” isdescribed in each of PB13 to PB15, and “0x31” representing “1” isdescribed in PB16. The body (PB0 to PB16) of Vendor-Specific InfoFrameis transmitted from the image processing apparatus 100 to the receivingapparatus 300 through TMDS Channel 1 and TMDS Channel 2 included in theTMDS line 202.

A method, performed by the image processing apparatus 100, fortransmitting data indicating a file name will now be described.

In the case where the image processing apparatus 100 is in the capturingmode and image data generated by the image sensing unit 104 and theimage processing unit 105 is being recorded in the recording medium 106a, additional data describes a file name of a file that is beingrecorded. In this case, the receiving apparatus 300 is informed of thefile name of the file which is being recorded in the image processingapparatus 100.

In the case where the image processing apparatus 100 is in the capturingmode and image data generated by the image sensing unit 104 and theimage processing unit 105 is not recorded in the recording medium 106 a,additional data describes a file name of the next file to be recorded.In this case, the receiving apparatus 300 is informed of the file nameof the next file to be recorded in the image processing apparatus 100.

At completion of recording of image data generated by the image sensingunit 104 and the image processing unit 105 in the recording medium 106a, the CPU 101 changes a file name described in additional data to afile name of the next file to be recorded. The same applies to a casewhere recording of image data generated by the image sensing unit 104and the image processing unit 105 in the recording medium 106 a isstopped. When recording of image data generated by the image sensingunit 104 and the image processing unit 105 in the recording medium 106 ais started, the CPU 101 changes a file name described in additional datato a file name of a file which is being recorded.

The receiving apparatus 300 will now be described with reference to FIG.7. The receiving apparatus 300 includes a CPU 301, an image processingunit 302, a communication unit 303, a recording unit 304, an operationunit 305, a memory 306, a display unit 307, and a file generating unit308.

The CPU 301 controls an operation of the receiving apparatus 300 inaccordance with a computer program stored in the memory 306.

The image processing unit 302 performs various image processes on anyone of image data read from a recording medium 304 a by the recordingunit 304 and image data received from the image processing apparatus 100by the communication unit 303. The image data subjected to the imageprocesses by the image processing unit 302 is supplied to at least oneof the recording unit 304 and the display unit 307.

The communication unit 303 includes a connection terminal for connectionof the connection cable 200. The communication unit 303 receives imagedata and additional data transmitted from the image processing apparatus100 through the TMDS line 202. The image data received from the imageprocessing apparatus 100 by the communication unit 303 is supplied to atleast one of the image processing unit 302, the recording unit 304, thedisplay unit 307, and the file generating unit 308. The additional datareceived from the image processing apparatus 100 by the communicationunit 303 is supplied to the file generating unit 308.

The recording unit 304 records image data supplied from the imageprocessing unit 302 in the recording medium 304 a. Furthermore, therecording unit 304 can supply image data recorded in the recordingmedium 304 a to at least one of the image processing unit 302 and thedisplay unit 307. The recording medium 304 a may be a memory built inthe receiving apparatus 300 or may be an external memory removable fromthe receiving apparatus 300.

The operation unit 305 provides a user interface for operating thereceiving apparatus 300.

The memory 306 functions as a work area of the CPU 301. Furthermore, thememory 306 stores EDID to be transmitted to the image processingapparatus 100 through the DDC line 201.

The display unit 307 displays an image based on image data supplied fromany one of the communication unit 303, the image processing unit 302,and the recording unit 304.

The file generating unit 308 generates a file using additional data andimage data supplied from the communication unit 303. The generated fileis supplied to the recording unit 304 and is then recorded in therecording medium 304 a.

FIG. 8 illustrates an example of a file generated by the file generatingunit 308. The file illustrated in FIG. 8 is generated by the filegenerating unit 308 upon reception of the additional data illustrated inFIG. 6 from the image processing apparatus 100 by the receivingapparatus 300. The file illustrated in FIG. 8 contains image data, dataindicating the file name “MVI_0001”, data indicating the first framerate “30p”, and data indicating the second pixel range “16 to 255”. Thefile illustrated in FIG. 8 further contains data items indicating timecodes for frames of the image data. The file generating unit 308generates the data indicating the file name, the data indicating thefirst frame rate, and the data indicating the second pixel range, whichare contained in the file of FIG. 8, based on the additional datareceived from the image processing apparatus 100. In addition, the filegenerating unit 308 generates the data items indicating the time codesfor the frames of the image data contained in the file of FIG. 8 basedon the additional data received from the image processing apparatus 100.The file generating unit 308 associates the time code for each framedescribed in the additional data supplied from the communication unit303 with the corresponding frame included in the image data suppliedfrom the communication unit 303, thus generating the file. According todigital camera system requirements, in cases where the file generatingunit 308 generates a file containing image data received from the imageprocessing apparatus 100, the receiving apparatus 300 cannot specify afile name of the generated file to the image processing apparatus 100.

The receiving apparatus 300 generates the file illustrated in FIG. 8, sothat the receiving apparatus 300 can manage the image data received fromthe image processing apparatus 100 together with data relating to theimage data to be transmitted by the image processing apparatus 100. Inaddition, the receiving apparatus 300 can control the image processingunit 302 to edit image data received from the image processing apparatus100 using additional data received from the image processing apparatus100. Accordingly, the receiving apparatus 300 can reconstruct image datato be transmitted by the image processing apparatus 100.

As described above, when image data is transmitted from the imageprocessing apparatus 100 according to the first embodiment to thereceiving apparatus 300, data relating to the image data to betransmitted is transmitted to the receiving apparatus 300 by the imageprocessing apparatus 100. Accordingly, the receiving apparatus 300 candetermine what the image data received from the image processingapparatus 100 has been before transmission. Consequently, if image datagenerated in the image processing apparatus 100 has been subjected to aconversion process for transmission to the receiving apparatus 300, thereceiving apparatus 300 can reconstruct the image data to be subjectedto the conversion process. Accordingly, if the image quality of imagedata received by the receiving apparatus 300 has been degraded by theconversion process, the receiving apparatus 300 can reconstructhigh-quality original image data from the image data received from theimage processing apparatus 100. In this case, the receiving apparatus300 can record the high-quality image data generated in the imageprocessing apparatus 100. Furthermore, the receiving apparatus 300 canedit the high-quality image data generated in the image processingapparatus 100. In addition, the receiving apparatus 300 enables thehigh-quality image data generated in the image processing apparatus 100to be viewed. When transmitting image data to the receiving apparatus300, therefore, the image processing apparatus 100 informs the receivingapparatus 300 of data relating to the image data to be transmitted tothe receiving apparatus 300, thus enabling the receiving apparatus 300to appropriately manage the image data.

Furthermore, the image processing apparatus 100 informs the receivingapparatus 300 of the second pixel range, thus enabling the receivingapparatus 300 to determine whether the pixel range of the image datatransmitted to the receiving apparatus 300 is “16 to 255” or “16 to235”.

In addition, the image processing apparatus 100 informs the receivingapparatus 300 of a file name and time codes, thus enabling the receivingapparatus 300 to generate a file whose file name and time codes areidentical to those of a file recorded in the image processing apparatus100.

Although additional data is transmitted to the receiving apparatus 300using Vendor-Specific InfoFrame in the first embodiment, packet data isnot limited to Vendor-Specific InfoFrame.

For example, the image processing apparatus 100 may inform the receivingapparatus 300 of at least one of the first frame rate, the second pixelrange, and the time codes using Source Product Descriptor InfoFrame.

Furthermore, for example, the image processing apparatus 100 may informthe receiving apparatus 300 of additional data using HDMI Ethernet(registered trademark) Channel (HEC). In this case, the additional datais transmitted from the image processing apparatus 100 to the receivingapparatus 300 via Ethernet (registered trademark).

Furthermore, for example, the image processing apparatus 100 may informthe receiving apparatus 300 of additional data using a command compliantwith the CEC protocol. In this case, the command compliant with the CECprotocol is, for example, <Vendor Command with ID>. The <Vendor Commandwith ID> is a command that contains Vendor ID and can be defined foreach manufacturer (maker). In this case, the additional data istransmitted from the image processing apparatus 100 to the receivingapparatus 300 through the CEC line 203.

Second Embodiment

In a second embodiment, a description of the same components as those inthe first embodiment is omitted and the difference between the secondembodiment and the first embodiment will be described below.

An image processing apparatus 100 according to the second embodimenttransmits additional data using <Vendor Command with ID> defined in theCEC protocol to a receiving apparatus 300. In this case, the receivingapparatus 300 records a file whose file name and time codes areidentical to those of a file recorded in the image processing apparatus100 based on the additional data received from the image processingapparatus 100 using <Vendor Command with ID>.

An operation of the image processing apparatus 100 and an operation ofthe receiving apparatus 300 in editing of image data will be describedbelow with reference to FIGS. 9A and 9B.

FIG. 9A illustrates a process in which a file recorded in the imageprocessing apparatus 100 is used as a main image and a file generatedbased on additional data by the receiving apparatus 300 is used as aproxy image.

In cases where a data transmitting unit 103 b transmits image data tothe receiving apparatus 300 through a TMDS line 202 and image datagenerated by an image sensing unit 104 and an image processing unit 105is not recorded in a recording medium 106 a, a CPU 101 performs aprocess in S1. In S1, the CPU 101 controls a command processing unit 103c to transmit <Vendor Command with ID> containing a file name of thenext file to be recorded by the image processing apparatus 100 to thereceiving apparatus 300. Hereinafter, <Vendor Command with ID>containing the file name of the next file to be recorded by the imageprocessing apparatus 100 will be referred to as a “first command”. Thefirst command contains data indicating the first frame rate and dataindicating the second pixel range.

In S2, the user inputs an operation signal to start recording of imagedata through an operation unit 108 to the image processing apparatus100. In this case, the CPU 101 controls a file generating unit 106 b togenerate a file containing image data generated by the image sensingunit 104 and the image processing unit 105. In this case, in S3, the CPU101 controls the command processing unit 103 c to transmit <VendorCommand with ID> containing a file name of the file generated by thefile generating unit 106 b to the receiving apparatus 300. Hereinafter,<Vendor Command with ID> containing the file name of the file generatedby the file generating unit 106 b will be referred to as a “secondcommand”. The second command further contains data indicating the firstframe rate, data indicating the second pixel range, and data indicatingtime codes for image data contained in the file to be recorded in therecording medium 106 a.

In S4, the user inputs an operation signal to start recording of imagedata through an operation unit 305 to the receiving apparatus 300. Inthis case, a CPU 301 controls a file generating unit 308 to generate afile using the image data received from the image processing apparatus100 by a communication unit 303 and the second command transmitted fromthe image processing apparatus 100 in S3. In this case, the filegenerating unit 308 generates the file whose file name and time codesare identical to those of the file generated by the file generating unit106 b.

In S5, the user inputs an operation signal to end the recording of theimage data through the operation unit 305 to the receiving apparatus300. In this case, the CPU 301 controls a recording unit 304 to recordthe file generated by the file generating unit 308 in a recording medium304 a.

In S6, the user inputs an operation signal to end the recording of theimage data through the operation unit 108 to the image processingapparatus 100. In this case, the CPU 101 controls a recording unit 106to record the file generated by the file generating unit 106 b in therecording medium 106 a. After that, image data generated by the imagesensing unit 104 and the image processing unit 105 is not recorded inthe recording medium 106 a.

Subsequently, in S7, the CPU 101 controls the command processing unit103 c to transmit the first command to the receiving apparatus 300 inthe same way as in the process in S1. The process in S7 is performed bythe CPU 101 until an operation signal to start recording of image datais input through the operation unit 108 to the image processingapparatus 100.

FIG. 9B illustrates a process in which a file recorded in the imageprocessing apparatus 100 is used as a proxy image and a file generatedbased on additional data by the receiving apparatus 300 is used as amain image.

In cases where the data transmitting unit 103 b transmits image datathrough the TMDS line 202 to the receiving apparatus 300 and image datagenerated by the image sensing unit 104 and the image processing unit105 is not recorded in the recording medium 106 a, the CPU 101 performsa process in S11. In S11, the CPU 101 controls the command processingunit 103 c to transmit the first command to the receiving apparatus 300in the same way as in the process in S1.

In S12, the user inputs an operation signal to start recording of imagedata through the operation unit 305 to the receiving apparatus 300. Inthis case, the CPU 301 controls the file generating unit 308 to generatea file using image data received from the image processing apparatus 100by the communication unit 303 and the first command transmitted from theimage processing apparatus 100 in S11.

In S13, the user inputs an operation signal to start recording of imagedata through the operation unit 108 to the image processing apparatus100. In this case, the CPU 101 controls the file generating unit 106 bto generate a file containing image data generated by the image sensingunit 104 and the image processing unit 105. In this case, in S14, theCPU 101 controls the command processing unit 103 c to transmit thesecond command to the receiving apparatus 300. In this case, the CPU 301controls the file generating unit 308 to replace a file name containedin the file generated in S12 with a file name contained in the secondcommand transmitted from the image processing apparatus 100 in S14.Furthermore, in this case, the CPU 301 adds data indicating time codescontained in the second command transmitted from the image processingapparatus 100 in S14 to the file generated in S12.

In S15, the user inputs an operation signal to end the recording of theimage data through the operation unit 108 to the image processingapparatus 100. In this case, the CPU 101 controls the recording unit 106to record the file generated by the file generating unit 106 b in therecording medium 106 a. After that, image data generated by the imagesensing unit 104 and the image processing unit 105 is not recorded inthe recording medium 106 a.

In S16, the CPU 101 controls the command processing unit 103 c totransmit the first command to the receiving apparatus 300 in the sameway as in S11. The CPU 101 performs a process in S16 until an operationsignal to start recording of image data is input through the operationunit 108 to the image processing apparatus 100.

In S17, the user inputs an operation signal to end the recording of theimage data through the operation unit 305 to the receiving apparatus300. In this case, the CPU 301 controls the recording unit 304 to recordthe file generated by the file generating unit 308 in the recordingmedium 304 a.

If the first frame rate in the first command differs from the firstframe rate in the second command, the CPU 301 may replace the firstframe rate described in the file generated by the file generating unit308 with the latest first frame rate. Furthermore, if the second pixelrange in the first command differs from the second pixel range in thesecond command, the CPU 301 may replace the second pixel range describedin the file generated by the file generating unit 308 with the latestsecond pixel range.

As described above, the image processing apparatus 100 according to thesecond embodiment informs the receiving apparatus 300 of a file name andtime codes, thus enabling the receiving apparatus 300 to generate a filewhose file name and time codes are identical to those of the filerecorded in the image processing apparatus 100. In editing image data,therefore, the image processing apparatus 100 according to the secondembodiment enables a file recorded in the image processing apparatus 100to be used as a main image and enables a file generated in the receivingapparatus 300 to be used as a proxy image. Furthermore, in editing imagedata, the image processing apparatus 100 according to the secondembodiment enables a file recorded in the image processing apparatus 100to be used as a proxy image and enables a file generated in thereceiving apparatus 300 to be used as a main image.

The first frame rate in the first and second embodiments is not limitedto 30p.

The second pixel range in the first and second embodiments is notlimited to “16 to 255”. The second pixel range may be “64 to 1023” in asystem that represents a color space with a 10-bit width. In this case,the black level in the second pixel range is “64” and the white level inthe second pixel range is “1023”.

The image processing apparatus 100, the connection cable 200, and thereceiving apparatus 300 in the first and second embodiments may becompliant with a standard compatible with the HDMI standard.

The image processing apparatus 100, the connection cable 200, and thereceiving apparatus 300 in the first and second embodiments may becompliant with the Digital Visual Interface (DVI) (registered trademark)standard.

Furthermore, the image processing apparatus 100, the connection cable200, and the receiving apparatus 300 in the first and second embodimentsmay be compliant with the Display Port (registered trademark) standard.

In addition, the image processing apparatus 100, the connection cable200, and the receiving apparatus 300 in the first and second embodimentsmay be compliant with the Digital Interface for Video and Audio (DiiVa).

The image processing apparatus 100, the connection cable 200, and thereceiving apparatus 300 in the first and second embodiments may becompliant with the Mobile High-definition Link (MHL) (registeredtrademark) standard.

The image processing apparatus 100, the connection cable 200, and thereceiving apparatus 300 in the first and second embodiments may becompliant with the Universal Serial Bus (USB) standard.

Furthermore, image data generated by the image processing apparatus 100in the first and second embodiments may be transmitted to the receivingapparatus 300 in a wireless manner. Accordingly, the image processingapparatus 100 and the receiving apparatus 300 in the first and secondembodiments may be compliant with the Wireless HD (registered trademark)standard. In addition, the image processing apparatus 100 and thereceiving apparatus 300 in the first and second embodiments may becompliant with the Wireless Home Digital Interface (WHDI) standard.

Other Embodiments

An image processing apparatus according to the present invention is notlimited to the image processing apparatus 100 described in the first andsecond embodiments. Furthermore, a receiving apparatus according to thepresent invention is not limited to the receiving apparatus 300described in the first and second embodiments. The image processingapparatus according to the present invention can be implemented by, forexample, a system including a plurality of devices. Furthermore, thereceiving apparatus according to the present invention can beimplemented by, for example, a system including a plurality of devices.

Furthermore, the processes, configurations, functions, and systemsdescribed in the first and second embodiments can be implemented by acomputer program executable by a computer. In this case, the computerprogram is read from a computer-readable recording medium by thecomputer and is executed by the computer. In this case, examples of thecomputer-readable recording medium include a hard disk drive, an opticaldisk, a CD-ROM, a CD-R, a memory card, and a ROM. The computer programmay be provided from an external device through a communicationinterface to the computer and be executed by the computer.

While the present invention has been described with reference toexemplary embodiments, it is to be understood that the invention is notlimited to the disclosed exemplary embodiments. The scope of thefollowing claims is to be accorded the broadest interpretation so as toencompass all such modifications and equivalent structures andfunctions.

1. An image processing apparatus comprising: a communication unit thatis used for connecting with an external apparatus; and a control unitthat generates a second image by using a first image so that a framerate of the second image is a frame rate defined by the specificcommunication standard, wherein a frame rate of the first image is afirst frame rate, the frame rate of the second image is a second framerate, wherein the control unit controls a process for transmitting thesecond image to the external device and controls a process fortransmitting predetermined data relating to the second image to theexternal device, and wherein the predetermined data includes informationindicating the first frame rate.
 2. The image processing apparatusaccording to claim 1, wherein the predetermined data includesinformation indicating a name of a file relating to the second image. 3.The image processing apparatus according to claim 1, wherein thepredetermined data includes information indicating a time code relatingto each frame included in the second image.
 4. The image processingapparatus according to claim 1, further comprising an image sensor thatconverts an optical image to analog data, wherein the first image isobtained by using the image sensor.
 5. The image processing apparatusaccording to claim 1, wherein the control unit reads an image from arecording medium, wherein the first image is an image read by thecontrol unit.
 6. The image processing apparatus according to claim 1,wherein the control unit generates the second image by using informationrelating to a display capability of the external device.
 7. The imageprocessing apparatus according to claim 6, wherein the informationrelating to a display capability of the external device is at least oneof Extended display identification data (EDID) and Enhanced Extendeddisplay identification data (E-EDID).
 8. The image processing apparatusaccording to claim 1, wherein the predetermined data includesinformation indicating that a format of the first image is an interlacedformat or a progressive format.
 9. The image processing apparatusaccording to claim 1, wherein the control unit controls a process fortransmitting the predetermined data to the external device according toEthernet.
 10. The image processing apparatus according to claim 1,wherein the control unit controls a process for transmitting thepredetermined data to the external device according to High-DefinitionMultimedia Interface (HDMI).
 11. The image processing apparatusaccording to claim 1, wherein the predetermined data is used for causingthe external device to edit the second image transmitted from the imageprocessing apparatus.
 12. The image processing apparatus according toclaim 1, wherein the predetermined data is used for causing the externaldevice to generate the first image from the second image.
 13. The imageprocessing apparatus according to claim 1, wherein the image processingapparatus includes a camera.
 14. A control method for controlling animage processing apparatus connecting with an external apparatus, thecontrol method comprising: generating a second image by using a firstimage so that a frame rate of the second image is a frame rate definedby the specific communication standard, wherein a frame rate of thefirst image is a first frame rate, the frame rate of the second image isa second frame rate; transmitting the second image to the externaldevice; and transmitting predetermined data relating to the second imageto the external device, wherein the predetermined data includesinformation indicating the first frame rate.